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(54) System and method for processing and managing electronic copies of handwritten notes 



(57) A system and method for processing and man- 
aging electronic copies of handwritten notes are provid- 
ed. The system includes a processor (1 2) for processing 
the handwritten notes to generate the electronic copies, 
with each electronic copy associated with a respective 
identifier corresponding to at least one set of the respec- 



tive handwritten notes, in which the identifiers facilitate 
the management of the electronic copies. The system 
includes an electronic notepad (1 0) and can also include 
devices (1 4,20) operatively connected to the electronic 
notepad for operating with the electronic notepad to re- 
ceive, manage, merge, and/or display the electronic 
copies from the electronic notepad. 
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Des ription 

BACKGROUND INFORMATION 

1. Technical Field 

This disclosure relates to information processing, 
and more particularly, to a system and method for 
processing and managing multiple pages of handwritten 
notes in electronic form. 

2. Description of the Related Art 

Recently, a number of electronic/computer-based 
notepads using pen-based computers and/or tablets 
have been developed and marketed as personal digital 
assistants such as the "NEWTON" available from "AP- 
PLE". These personal digital assistants can be portable 
and generally do not use relatively bulky input devices 
such as a keyboard or a mouse. 

Some electronic notepads can be used to analyze, 
recognize, and/or convert handwritten information into 
digital text. An example of such an electronic notepad 
is disclosed in U.S. Patent No. 5,329,625 to Kannan et 
al. Other electronic notepads can involve the simple 
capture of handwritten notes and sketches, i.e. hand- 
writing and symbol recognition are not required. Thus 
such handwriting-capturing devices can be implement- 
ed in simpler and less expensive forms. 

One type of electronic notepad provides for both a 
standard ink and paper copy as well as an electronic 
copy, with actual paper and/or a stack or pad of paper 
positioned over a handwriting-capturing device such as 
a capacitance sensitive, pressure-sensitive, touch-sen- 
sitive, or proximity-sensing tablet. Such handwriting- 
capturing tablets are known in the art, such as the infor- 
mation processing tablet described in commonly as- 
signed U.S. Patent No. 5, 1 1 3,041 , which is incorporated 
herein by reference. 

In using such an electronic notepad, the tracking of 
correct correspondences between the paper copies of 
notes and the electronic copies can pose difficulties. 
One difficulty sometimes occurs when a user intends to 
position a new sheet of paper on the tablet. Typically, 
the electronic notepad has to be instructed when to 
close or end the current electronic page and when to 
open or create a new page. Another difficulty occurs if 
the user attempts to return to a previous sheet to modify 
pr viously stored electronic notes. A set of buttons, sen- 
sors, or icons, implemented in hardware and/or software 
in the electronic notepad, can be provided for receiving 
signals from the user indicating the desired page. Such 
implementations can increase the complexity of use and 
the xpens of the d vice. 

SUMMARY 

It is recognized that a system and method for man- 



aging pages electronically stored in an el ctronic not - 
pad can be implemented in a relatively simple and inex- 
pensive manner to improve such note-taking capabili- 
ties. An electronic notepad for managing electronic cop- 

5 ies of handwritten notes is disclosed, which includes a 
processor for processing the handwritten notes to gen- 
erate the electronic copies. 

Each electronic copy is associated with a respective 
identifier corresponding to at least one set of the respec- 

io tive handwritten notes, in which the identifiers facilitate 
the management of the electronic copies. The system 
includes an electronic notepad and can also include de- 
vices operatively connected to the electronic notepad 
for operation therewith to receive, manage, merge, and/ 

is or display the electronic copies from the electronic note- 
pad. 

In an illustrative embodiment, a handwriting captur- 
ing device having a surface is used for generating data 
signals from sequences of x-y coordinates of a pen de- 
20 vice employed substantially close to the surface. The 
sequences of x-y coordinates correspond to a plurality 
of sessions of handwritten notes written substantially 
adjacent the surface on a plurality of pages. 

Each session corresponds with a time period during 
which a collection of notes are made without being in- 
terrupted for the purpose of making a second collection 
of notes. Each session of handwritten notes includes a 
handwritten page identifier, and the data signals include 
a respective electronic identifier corresponding to a re- 
spective handwritten page identifier The electronic 
identifiers of the plurality of sessions facilitate the man- 
agement of the electronic copies, such as the collecting 
together and merging of sessions having similar identi- 
fiers. 

Thus, the tracking of correct correspondences be- 
tween the paper copies of notes and the electronic cop- 
ies can be performed without requiring the closing of a 
current electronic page or the opening or creation of a 
new page. The disclosed electronic notepad using iden- 
tifiers of sessions allows a user to return to a previous 
sheet of handwritten notes to modify previously stored 
electronic notes without requiring additional buttons, 
sensors, or icons. Thus the storage and management 
of handwritten notes in electronic form can be imple- 
mented in a simple manner with minimal manufacturing 
expense. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The features of the disclosed electronic notepad 
system and method will become more readily apparent 
and can be better understood by referring to the follow- 
ing detailed description of an illustrative embodiment, 
taken in conjunction with the accompanying drawings, 
wh re: 

FIG. 1 is a block diagram of the components of the 
disclosed electronic notepad; 
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FIG. 2 illustrates a pag notation being transcrib d 
on a sheet of paper on the disclosed electronic note- 
pad; 

FIG. 3 illustrates the disclosed electronic notepad 
of FIG. 2 having notes being transcribed on the pa- 
per; 

FIG. 4 is a flowchart of the method of operation of 
the disclosed electronic notepad system; 
FIGS. 5-7 illustrate alternative modes of operation 
using page identifiers; 

FIG. 8 is aflowchart of the disclosed method for per- 
forming a download and merge function; 
FIG. 9 illustrates an embodiment of a disclosed 
electronic notepad system; 
FIG. 10 illustrates a cut-away view of a disclosed 
electronic notepad; 

FIG. 11 illustrates the disclosed electronic notepad 
remotely linked to a display system; and 
FIG. 12 illustrates the disclosed electronic notepad 
with a hinged cover. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Referring now in specific detail to the drawings, with 
like reference numerals identifying similar or identical 
elements, as shown in FIG. 1, the present disclosure 
relates to an electronic notepad system and method of 
use for managing pages electronically stored therein. 
The electronic notepad system includes: electronic 
notepad 10 having processor 12 operatively connected 
to input device 1 4; memory 1 6; stored programs 1 8; and 
output device 20. Power source 22 is also provided, 
which can include a power adapter and/or a battery to 
allow electronic notepad 10 to be portable. 

In an exemplary embodiment, processor 1 2 can be, 
for example, a 16C57 microprocessor available from 
"MICROCHIP", and memory 16 can include about 128 
kilobytes of random access memory. Such components 
implement electronic notepad 10 with relatively low 
power consumption and at relatively low cost. Alterna- 
tively, electronic notepad 10 can be implemented using 
a "PENTIUM", available from "INTEL", as processor 12. 
Memory 16 can include about 8 megabytes of random 
access memory. 

Electronic notepad 10 can store several written 
pages of notes in one data file representing electronic 
pages or sessions of handwriting in electronic notepad 
1 0 until the data file is downloaded, for example, into the 
memory of a computer system such as a personal com- 
puter or a control box. The control box can include a 
memory buffer for subsequent processing, as described 
in greater detail below. 

Input d vice 14 includes handwriting capturing de- 
vice 24 having op rative surface 26 for receiving the 
handwritt n notes and other data and commands from 
the user. Input device 1 4 can also include additional but- 
tons and devices, such as a mouse, for supplementing 



the functions of surfac 26. 

Output device 20 can include at least one data port 
and/or a transmitter for outputting the data files during 
a download mode. Output device 20 can also include a 
s display and can be combined, at least in part, with input 
device 14 to provide a display for interactive operation. 

Stored programs 18 can be compiled or interpreted 
from source code written, for example, in C-hk These 
programs are executed by processor 12 to perform the 
10 disclosed electronic notepad system and method for de- 
tecting, collecting, and managing the handwritten pages 
in a relatively simple and inexpensive manner to be elec- 
tronically stored in memory 1 6 and to facilitate note-tak- 
ing. As shown in FIGS. 2-3, electronic notepad 10, using 
is processor 12 executing stored programs 18, electroni- 
cally captures handwritten notes 28 written by the user 
on sheet of paper 30. Paper 30 is attached by clip 32 to 
electronic notepad 10, with handwritten notes 28 writ- 
ten, for example, using pen 34. Pen 34 can be incorpo- 
rated into input device 1 4. 

For clarity of explanation, the illustrative embodi- 
ment of the disclosed electronic notepad system and 
method is presented as having individual functional 
blocks, which can include functional blocks labelled as 
"processor 1 ' and "processing unit". The functions repr - 
sented by these blocks can be provided through the us 
of either shared or dedicated hardware, including, but 
not limited to, hardware capable of executing softwar . 
For example, the functions of the processor and 
processing unit presented herein can be provided by a 
shared processor or by a plurality of individual proces- 
sors. 

Moreover, the use of the functional blocks with ac- 
companying labels herein is not to be construed to refer 
exclusively to hardware capable of executing software. 
Illustrative embodiments can include digital signal 
processing hardware, such as the AT&T DSP16 or 
DSP32C, read-only memory for storing software per- 
forming the operations discussed below, and random 
access memory for storing digital signal processing re- 
sults. Very large scale integration hardware embodi- 
ments, as well as custom very large scale integration 
circuitry, in combination with a general purpose digital 
signal processing circuit, can also be provided. Any and 
all of these embodiments fall within the meaning of the 
labels for the functional blocks as used herein. 

Processor 12 is also capable of interfacing with ex- 
ternal devices for downloading the electronically cap- 
tured pages. In the disclosed electronic notepad meth- 
od, a user controls the management of electronically 
captured pages for identifying and ordering both paper 
pages and the corresponding electronic pages. Such 
management of the electronically captured pages can 
be impl m nt d in a natural mann r; for example, by 
marking the upper right comer of handwritten page 30 
with identifi r 36, as shown in FIG. 2. This id ntifier 36 
is then captured as an electronic identifier oh the elec- 
tronic page. Subsequent notes 28 can then be written, 
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as shown in FIG. 3, for electronic storage and associa- 
tion with identifier 36. 

A flowchart of the operation of the disclosed elec- 
tronic notepad system and method is shown in FIG. 4. 
After power is turned on in step 38, processor 1 2 deter- 
mines if any writing by the user in step 40 is detected by 
surface 26. If no writing is detected after a predeter- 
mined period of time; for example, one minute, proces- 
sor 1 2 determines if a shutdown command has been re- 
ceived by the user in step 42. Upon receiving a shut- 
down command in step 42, processor 12 enters a shut- 
down mode in step 44, in which open files are closed 
and any previous writing by the user is stored in a data 
file. If a shutdown command has not been received in 
step 42, processor 12 loops back to wait for writing in 
step 40. In looping back and waiting, processor 12 can 
optionally enter a power-saving mode in a manner 
known in the art. 

Upon detection of writing in step 40, processor 12 
stores in memory 16 the pen strokes corresponding to 
the writing as the user's notes in a time-contiguous col- 
lection or session of handwriting data points. These data 
points are typically a sequence of x-y coordinates used 
in orienting the detection of the writing on paper 30. After 
the writing is stored in memory 16, processor 12 loops 
back to execute step 40 to wait for additional writing. 

Any pen strokes in the upper right corner corre- 
spond to a user-specified identifier such as shown in 
FIGS. 2-3. This is particularly adaptable for providing us- 
er-drawn icons as well as for using non-Roman alpha- 
betical characters and notations for such languages as 
Arabic and Hebrew; accented characters and notations 
such as a cedilla; as well as multi-character languages 
such as Japanese and Chinese. 

Identifier 36 can be implemented, for example, by 
accepting the writing in the upper right corner to be the 
associated identifier; i.e. such writing can be stored as 
an image, such as a bitmap, and accessed by, for ex- 
ample, a computer system with the image of the identi- 
fier acting as an icon. In addition, the writing in the upper 
right comer can act as an indicator to electronic notepad 
10 to generate a successive number or letter, such as 
°1 D , "2°, etc., to establish an order between stored elec- 
tronic pages. Each writing can also be imaged; for ex- 
ample, bitmapped, and indexed by such generated 
numbers. 

Other identifiers can be generated using the com- 
puter system by graphically shrinking or scaling the cur- 
rently stored electronic page, corresponding to written 
notes, to an image, such as a bitmap, which can then 
be used as an icon. In addition, electronic notepad 10 
can support a keyview feature in which the user speci- 
fies, by a command or predetermined set of pen strokes, 
a portion or all of th currently stor d I ctronic pag to 
be graphically shrunk or seal d to be the image. The 
identifier can also be generated by a timestamp using a 
timer associated with processor 12 in FIG. 1 . 

Furthermore, the identifier can be generated by in- 
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corporating a telephone number obtained through a 
connection with a telephone using, for example, caller 
identification for use with an incoming call, a dialed tel- 
ephone number for use with an outgoing call, or a spec- 
5 rfied speed-dial number stored in a memory of a tele- 
phone operatively connected to electronic notepad 10. 
Thus handwritten notes taken during a telephone con- 
versation can be identified by the telephone number of 
another party in the conversation. Still further, input de- 
10 vice 14 of electronic notepad 10 can incorporate a mi- 
crophone and/or video connection for generating multi- 
media identifiers, in a manner known in the art. 

The operation of the method described above and 
as shown in FIG. 4 is further illustrated in FIGS. 5-7 to 
*s provide alternative modes of generating identifiers of 
handwritten notes. As shown in FIG. 5(a), in one em- 
bodiment blank page 48 has identifier 36 written there- 
upon in the upper right corner, for example, by writing a 
T. In FIG. 5(b), notes 50 written on page 48 outside 
the upper right corner can then be taken and stored pro- 
gressively in memory 16. The actual writing on sheet of 
paper 30 over surface 26 is illustrated in FIGS. 2-3, with 
FIG. 2 corresponding to FIG. 5(a) and FIG. 3 corre- 
sponding to FIG. 5(b). The entry of the "1° in the upper 
right corner as identifier 36 indicating the beginning of 
note-taking on sheet of paper 30, represented in FIGS. 
5(a) and 5(b) as page 48. 

In FIG. 5(c), after changing to next sheet 52 of pa- 
per, the writing of new identifier 54, for example, "2" in 
the upper right corner, indicates a page change. Thus, 
pre-entry identification is supported, with each page 
identified initially, and new writing in the upper right cor- 
ner signalling electronic notepad 10 of a new page of 
handwritten notes. 

As shown in FIG. 6(a), another embodiment has 
sheet 56 of paper filled with notes, and then, in FIG. 6 
(b), the writing of "I" as identifier 36 in the upper right 
corner indicates a page change, so the entire page of 
notes 56, including identifier 36, is stored in memory 16. 
A new blank sheet of paper 58 is then used, as shown 
in FIG. 6(c). Thus, post-entry identification is supported, 
with each page being identified after the page is filled 
with notes. 

As shown in FIG. 7, a further embodiment illustrates 
the keyview feature implemented by a computer sys- 
tem, which can optionally be operated interactively with 
electronic notepad 10 to identify electronic pages. Elec- 
tronic page 60, which can be displayed to the user by 
the computer system, is shown in FIG. 7(a) as being 
filled with data corresponding to handwritten notes. A 
predetermined set of user inputs activates a keyview 
procedure in the computer system to determine a set of 
notes to be used as a keyview identifier. For example, 
th predetermined s t of us r inputs can be input by a 
mouse to sweep bounded r gion 62 on the display, or 
by positioning pen 34, for example, for about 2 seconds 
on a predetermined location on paper 30. 

The user then enters user inputs to specific loca- 
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tions bounding a user-specified region of notes. For ex- 
ample, the user can specify two locations 64, 66 corre- 
sponding to locations in the electronic copy, as shown 
in FIG. 7(b), to block off specific notes, with the specific 
notes thus bordered by a rectangular box as region 62 
defined by opposing corner locations 64, 66. 

Electronic notepad 1 0 then automatically generates 
the identifier for the entire electronic page, as shown in 
FIG. 7(c), by graphically shrinking the specified notes in 
region 62 as image 68, and then positioning the image 
in the upper right corner to generate identified electronic 
page 70. 

The keyview feature can be performed by predeter- 
mined keys and/or a mouse operatively connected to 
electronic notepad 10; for example, a mouse and key- 
board can be included in the computer system to inter- 
actively select the specific notes. 

To add additional notes to be associated with a pre- 
viously written sheet of paper, the user can replace 
sheet of paper 30 in clip 32 to be positioned over surface 
26, or otherwise the user can use a new sheet of paper 
thus positioned. The user can then repeat identifier 36 
in the upper right corner of the positioned sheet. If the 
previously written sheet is so positioned, the user can 
trace over an existing identifier on that sheet. 

Electronic notepad 10 stores every session of hand- 
written notes in a single data file in memory 16. A ses- 
sion corresponding to additional notes are stored in a 
separate section of the single data file, and with each 
session included in an electronic page corresponding to 
a page of notes identified with a respective identifier. 
Even though the identifiers of the different electronic 
pages can appear somewhat different, although intend- 
ed to be the same identifier for both sheets of notes, 
even when tracing is performed, the disclosed electronic 
notepad system and method is capable of recognizing 
both identifiers as being substantially identical and then 
to merge the respective electronic pages, as described 
below. 

FIG. 8 illustrates a typical download and merge op- 
eration used in the disclosed electronic notepad system 
and method, which is performed, for example, by an ex- 
ternally connected computer system. Electronic note- 
pad 10 can be operatively connected to a processing 
unit of a computer system, with both electronic notepad 
10 and the computer system having appropriate soft- 
ware to interface together and to transfer electronic pag- 
es; for example, in a download/upload operation, re- 
spectively, in step 72. The transferred electronic pages 
of notes in electronic notepad 10 are then stored in a 
data file in a memory of the computer system. It is also 
contemplated that electronic notepad 10 can upload 
electronic pages as well, and optionally display and an- 
notat such lectronic pag s in a manner as d scribed 
above. 

After the download is perform d in step 72, the com- 
puter syst m determines in step 74 if an automatic 
merging procedure or automerge has been initiated by 



th user, or atternativ ly if th computer system has 
been pre-selected to execute the automerge procedure 
automatically. If automerge has not been initiated in step 
74, all electronic page identifiers are displayed on a dis- 
s play as screen icons in step 76. The user can indicate 
at least two icons as corresponding to notes belonging 
to the same electronic page, and then merge all such 
pages with similar identifiers in step 78. Upon complet- 
ing the merging of all pages with simitar identifiers, the 
merging procedure ends in step 80. 

If automerge has been initiated in step 74, pairs of 
page identifiers are compared in step 82, and the pairs 
of page identifiers are checked whether they match with- 
in a specified or predetermined threshold in step 84. If 
the two page identifiers do not match, the merge proc - 
dure branches to perform steps 86-90 to complete the 
comparison of pages, ff the two page identifiers do 
match in step 84, the merge procedure then branches 
to perform step 92 to merge the two identified pages into 
one electronic page; for example, the data files of each 
electronic page can be appended. The merged electron- 
ic pages can then be stored in a separate file and iden- 
tified with at least one of the page identifiers, as either 
one of the specified matching page identifiers represent- 
ing the information stored in the separate file. 

The merge procedure then determines in step' 86 if 
all of the electronic pages have been compared. If all 
have been compared, then the rnerge procedure ends 
in step 88; otherwise, the merge procedure continues 
the comparison of pages by looping back to perform 
step 82. 

Each electronic page can correspond to a session 
Sj of time-contiguous writing associated with an identi- 
fier lj, which is included, for example, at the beginning 
of the data file of the session. For a pair of sessions S jt 
S k with identifiers i Ja l k , respectively, the comparison in 
step 82 produces a value pOj.y which can be. for ex- 
ample, between 0 and 1 , which is a measure of the sim- 
ilarity of the identifiers l j( l k . For example, a value of p(lj, 
l k ) closer to 1 indicates that the identifiers lj, l k are more 
similar to each other. Such similarity measures for all 
pairs of identifiers are used to merge the corresponding 
sessions having identifiers sufficiently similar to each 
other. 

Clustering techniques and other methods known in 
the art can also be used, including pattern recognition 
methods, neural networks, and fuzzy logic. In an exem- 
plary embodiment, the comparison in step 82 uses a 
predetermined threshold e, such that p(lj,l k ) > e indi- 
cates sufficient similarity. In one embodiment, e is 
about .87. 

The original electronic page can include sessions 
S lP S 2 , S m , so downloading step 72 can create m 
el ctronic pag s with each page including on s ssion. 
For k = 1 , 2, m, and for each j with k < j < m, if Sj and 
S k are not currently in the sam electronic pag , p(ij,l k ) 
is det rmined, and the merging of the electronic pages 
including S:, S k occurs if p(l|, l k ) > e. This results in n 
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pages, with n £ m such that the n pages have the prop- 
erty that if pOj,!^ > then sessions Sj. S k are in the 
same page. 

Any similarity measures can be implemented, such 
as correlation factors known in the art; for example, us- 
ing scalar products of vectors representing coordinate 
samples between compared identifiers. The compari- 
son can also involve symbol recognition of the com- 
pared identifiers, which can be implemented as de- 
scribed in commonly assigned U.S. Patent No. 
5,333,209, which is incorporated herein by reference. 

Even though two or more sessions can be merged 
together into a single electronic page, they can subse- 
quently be separated by using a split page procedure, 
known in the art, if a particular merge is not desired. The 
user can also vary the threshold value e, for example, 
to conform to the quality of the user's penmanship or the 
type of identifiers or notes being created by the user us- 
ing electronic notepad 10, such as icons or complicated 
symbols which can be difficult to match by similarity 
measures using relatively high values of e. On the other 
hand, if two or more different identifiers are somewhat 
similar, then a higher value of e can be required to pre- 
v nt incorrect merges. 

In another embodiment, the automerge procedure 
can be one of stored programs 18 of electronic notepad 
10, which can be executed continuously as a back- 
ground task. Whenever the user specifies a new identi- 
fier, processor 1 2 of electronic notepad 10 can automat- 
ically compare the new identifier with the identifiers pre- 
viously stored for previous electronic pages. A match of 
identifiers can indicate that the user has returned to a 
previously written page. If a match occurs, any writing 
associated with the new identifier can be added to the 
previous electronic page with the overall electronic page 
including such writings being associated with one of the 
matched identifiers. 

In a further embodiment, all matching identifiers can 
be stored and compared with other identifiers to ensure 
that each combination of identifiers is ascertained as 
matching or non-matching. Once all identifiers have 
been compared with each other, a single identifier of 
each set of matched identifiers can be associated with 
all merged electronic pages. Alternatively, a set of 
matching identifiers can themselves be merged or cor- 
related to generate a generic matching identifier which 
is then associated with the merged electronic pages. 

The disclosed electronic notepad system and meth- 
od can be implemented as shown in FIGS. 9-1 2. Refer- 
ring to FIG 9, electronic notepad 10 can have at least 
one port, such as ports 94, 96, to be operatively con- 
nected to equipment such as telephone 98 and/or com- 
puter system 100 including processing unit 102, input 
d vices such as keyboard 1 04 and mous 1 06, and out- 
put devices such as display 1 08 or a printer (not shown). 

In the embodiment shown in FIG. 9, lectronic note- 
pad 1 0 is connected by wires or cables 110,112, respec- 
tively, to telephone 98 and processing unit 102 using, 



for exampl , serial ports and connections. It is under- 
stood that telephone 98 can be connected directly to 
computer system 100. Electronic notepad 10 and com- 
puter system 100 can thus be connected to the tele- 
s phone lines through telephone 98 and/or to a modem 
operatively connected to or internal to computer system 
100. Such connections through telephone 98 or through 
a modem can, for example, provide basic telephone 
functions, as well as incorporate messages and times- 

10 tamps of the electronic pages to be included in a corre- 
sponding data file transmitted from electronic notepad 
10 to computer system 100. 

Electronic notepad 10 can allow the user to write 
notes while speaking on telephone 98, to recall and dis- 

is play notes previously stored and downloaded electron- 
ically, and/or to search for earlier notes from stored elec- 
tronic pages. For example, the electronic pages can in- 
clude a caller's name or a particular time, and so the 
electronic pages can be searched for specific keywords, 

20 messages, or times. The connection of electronic note- 
pad 1 0 to telephone lines can also allow the user to com- 
municate remotely with other computer systems opera- 
tively connected to telephones or modems using elec- 
tronic notepad 10. 

25 Pen device 114, which includes pen 34, can be used 
with electronic notepad 10, with pen device 114 storing 
ink for writing notes to create handwritten notes, sketch- 
es, figures or any scribbling, without electronic notepad 
1 0 interfering with the natural action of the user in writing 

30 with a pen on a sheet of paper. Pen device 114 can be 
refillable; i.e. pen device 114 can have replaceable ink 
cartridges, or pen device 114 can include a clasp or oth- 
er means known in the art for attaching and/or removing 
a writing pen to electronic notepad 10. 

35 in one embodiment, shown in FIG. 9, pen device 
114 can be attached to electronic notepad 1 0 by an inert 
cord or cable. Optionally, pen device 114 can be elec- 
tronically connected to electronic notepad 10 by a sig- 
nal-carrying cable for providing data signals to proces- 

40 sor 1 2 of electronic notepad 1 0 for indicating, using a 
capacitance, pressure or proximity sensor or the like, 
when a writing end of pen device 1 1 4 is applied substan- 
tially adjacent to or removed from surface 26 of elec- 
tronic notepad 10; for example, page of paper 30 posi- 
es tioned on electronic notepad 10. 

Thus, sessions of handwritten notes can be indicat- 
ed, for example, from a predetermined pause in the us- 
er's writing by removal of pen device 1 1 4 from paper 30, 
which causes removal of the end of pen device 114from 

50 the handwriting-capturing device 24. 

In one embodiment using a capacitance-sensitive 
surface as handwriting-capturing device 24, removal of 
the end of pen device 1 1 4 causes a capacitance effect 
with the capacitance-s nsitiv surface to be removed, 

5S thus signaling the removal of pen d vice 114. 

In the embodiment shown in FIG. 9, processing unit 
102 includes softwar for operating computer system 
100 in either an interactive mode or a download mode 
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with electronic notepad 10. In the interactiv mode, 
computer system 100 can process signals from elec- 
tronic notepad 10 corresponding to notes being written 
on paper positioned on electronic notepad 1 0, and com- 
puter system 100 outputs such notes in a real-time man- 
ner; for example, the notes are displayed electronically 
on display 108 as the notes are written. Alternatively, 
the notes can be printed using a printer (not shown) as 
the notes are written. 

Electronic notepad 10 can store electronic pages in 
a single data file corresponding to respective pages of 
written notes, with the data file generated and stored as 
the written notes are written on paper 30 positioned on 
electronic notepad 10. Accordingly, the electronic pages 
can act in a manner similar to carbon copies for provid- 
ing copies, in electronic form, of the handwritten notes 
on the sheets of paper substantially simultaneous with 
the writing of the notes. Thus, the risk of losing the user's 
notes by the loss of the corresponding sheets of paper 
is reduced. 

In the exemplary embodiment, all electronic pages 
are stored in a single data file, but it is understood that 
each electronic page can be stored in a respective sin- 
gle data file, and also that multiple data files can be used 
to store a single electronic page. 

In the download mode : electronic notepad 10, upon 
instruction from the user, can transmit the data files as 
signals to computer system 100 for storage in memory 
and/or output on display 1 08 or to a printer (not shown). 
The output of such data files as electronic pages can 
thus be effected in real-time or at a later time. 

In this embodiment, each of the electronic pages 
generated by electronic notepad 10 from written notes 
can be associated with an identifier or indicia. Electronic 
notepad 10 can thus provide the electronic pages, in- 
cluding the associated identifiers, to computer system 
100 which executes specialized software to manage the 
various electronic pages, as described below; for exam- 
ple, to maintain an order of the electronic pages corre- 
sponding to the order of the written notes, or to merge 
those electronic pages with similar identifiers. 

Using commands from the user executed through 
keyboard 104 and mouse 106, computer system 100 
can, for example, merge different electronic pages to- 
gether, as in FIG. 8, or can separate an electronic page 
into multiple electronic pages. Computer system 100 
can also automatically merge electronic pages following 
the download if the associated page identifiers are sub- 
stantially similar. If any merging is done in error, compu- 
ter system 100 can provide the user with the option of 
splitting merged electronic pages; for example, back to 
the original state of each electronic page involved in the 
merge. 

As shown in greater d tail in FIG. 10, I ctronic 
not pad 10 has means for attaching at least one she t 
of pap r substantially adjacent to I ctronic not pad 10. 
In one embodiment, the means for attaching is defined 
to be clip 32, as shown in FIGS. 2-3 and 9-10, for at- 



taching and/or removing sh etofpap r 30 to electronic 
notepad 10. In particular, sheet of paper 30 is positioned 
substantially adjacent surface 26 of electronic notepad 
10, as illustrated in the cut-away view in FIG. 10. Surface 
s 26 is connected to or incorporated with handwriting-cap- 
turing device 24 s and electronic notepad 1 0 includes a 
graphics tablet having microprocessors, memory, and 
associated electronics, described above in reference to 
FIG. 1, for obtaining and storing handwritten notes in 
10 memory 16. 

In another embodiment, surface 26 of handwriting- 
capturing device 24 can include a display for displaying 
an electronic copy of the writing currently being placed 
on a particular page positioned substantially adjacent 
*s . surface 26. Such a display can also output computer- 
generated menus, action icons such as up and down 
buttons, and other information to assist the user in cap- 
turing and managing the user's handwriting. For exam- 
ple, the display can have an overall length longer than, 
20 for example, a longest length of the sheets of paper, and 
so the display can output such menus and the like, for 
example, below the bottom edge of the sheets of paper 
to provide graphic information to the user in conjunction 
with the writing of notes upon the sheets of paper. 

Electronic notepad 10 also includes at least one 
port such as data ports 94, 96 for attaching and/or r - 
moving at least one cable, such as cables 110, 112 in 
FIG. 9, for operatively connecting electronic notepad 10 
to external devices such as telephone 98 and process- 
ing unit 102 of computer system 100. As shown in FIG. 
10, pen device 1 1 4 is not required to be attached to elec- 
tronic notepad 10, but a cable or cord can optionally be 
included to attach and/or remove pen device 1 1 4 to and 
from electronic notepad 10, as in FIG. 9. 

In another embodiment shown in FIG. 1 1 , electronic 
notepad 10 can include pen device 114 and clip 32 for 
holding paper 30, and also includes transmitter 116 for 
establishing a wireless channel to control box 118, such 
as a set-top box, having receiver 1 20 and operatively 
connected to display 122. Wireless transmitter 116 and 
receiver 1 20 can be implemented in a manner known in 
the art for transmitting signals using, for example, infra- 
red, microwave and/or radio frequencies. Such signals 
can be used to transfer data corresponding to the elec- 
tronic copy of the user's handwriting, and control box 
118 processes such signals to generate an electronic 
copy of the user's handwriting in real-time or in a sub- 
stantially concurrent manner on display 122. 

Using this embodiment, electronic notepad 10, in 
conjunction with control box 118 having wireless receiv- 
er 120 and operatively connected to display 122, can 
provide substantially simultaneous viewing of the notes 
written by at least one user of a corresponding electronic 
notepad by an audience. In this configuration, electronic 
notepad 1 0 can b used in a classroom setting or in li u 
of an overh ad projector at a pr sentation or me ting. 

In another embodiment of the electronic notepad 
system, a folder-type implementation of electronic note- 
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pad 10 is shown in FIG. 12. In this embodiment, elec- 
tronic notepad 10 includes base portion 124 and cover 
portion 126. Base portion 124 includes various features 
as described above for FIGS. 9-11, such as clip 32 for 
holding sheet of paper 30 substantially adjacent surface 
26 of handwriting-capturing device 24, and having at 
least one data port, such as ports 94, 96 as in FIGS. 
9-10, and/or optionally transmitter 116, as in FIG. 11. 
Means known in the art can be used for connecting cov- 
er portion 126 to base portion 124 in a cover/base con- 
figuration. 

For example, the cover connecting means can in- 
clude a hinge, such as rotating hinge mechanism 128, 
as shown in FIG. 12, but can also include a resilient 
hinge or a resilient flap composed, for example, of bend- 
able plastic. It is also to be understood that other cover 
connecting means can be used, such as a wire or cable, 
so that cover portion 126 can be loosely connected to 
base portion 124. 

In the embodiment shown in FIG. 12, electronic 
notepad 10 can also include means for locking and un- 
locking base portion 1 24 and cover portion 1 26, such as 
clamp mechanism 1 30 for engaging complementary slot 
132. 

Cover portion 1 26 can include pad 1 34 for providing 
multiple sheets of paper, and optionally pen device 114 
is attached to and/or removably engages cover portion 
1 26 by a clamp mechanism, such as clasp 1 36. To pro- 
vide for a sealed arrangement between base portion 
1 24 and cover portion 126, relief surfaces 1 38, 140 can 
be provided with clip 32. paper 30, and surface 26 po- 
sitioned on first relief surface 1 38, and pad 1 34, pen de- 
vice 1 1 4, and clasp 1 36 positioned on second relief sur- 
face 1 40. 

As the sheets of paper from pad 134 are used, at 
least one sheet of paper is moved from cover portion 
126 to be positioned and held in place substantially ad- 
jacent to surface 26 by clip 32. 

In the embodiments of electronic notepad 1 0 shown 
in FIGS. 9-1 2 and throughout the present disclosure, the 
means for attaching paper, such as clip 32, can hold 
multiple sheets of paper at any one time. Thus, the user 
can save time in positioning multiple pages by clip 32 
as opposed to taking one sheet at a time from pad 1 34. 
Preferably, the number of sheets attached to the elec- 
tronic notepad 10 is to be minimized to enhance the 
electronic capturing of the handwriting by improving, for 
example, the localized application of capacitance to ca- 
pacitance-sensitive surface 26 of handwriting-capturing 
device 24. 

For a stack of sheets clipped by clip 32, once one 
sheet is written on and its writing is stored electronically, 
the sheet written upon can be folded over clip 32 to allow 
the us r to writ on the next sh t in th stack. Alterna- 
tively, a sh t of paper written upon can b returned to 
cover portion 126 for storage, for example, under pad 
134 or secured using another clip (not shown in FIG. 
12), and the previously written sheet of paper can also 



be re- insert d into clip 32 for further notes or annota- 
tions. 

While the disclosed electronic notepad system and 
method have been particularly shown and described 
5 with reference to the preferred embodiments, it is un- 
derstood by those skilled in the art that various modifi- 
cations in form and detail can be made therein. 



io Claims 

1. A system for managing electronic copies of hand- 
written notes, the system comprising: 

a processor for processing handwritten notes 
is to generate electronic copies, with each electronic 
copy associated with a respective identifier corre- 
sponding to at least one set of the respective hand- 
written notes, wherein the identifiers facilitate the 
management of the electronic copies. 

20 

2. The system of claim 1 wherein the identifier is as- 
sociated with a respective set of the handwritten 
notes provided to the processor subsequent to the 
providing of the respective identifier to the proces- 

2B sor. 

3. The system of claim 1 wherein the identifier is as- 
sociated with a respective set of handwritten notes 
provided to the processor prior to the providing of 

30 the respective identifier to the processor. 

4. The system of claim 1 wherein the identifier is gen- 
erated from a scaling of at least a portion of the 
handwritten notes to be associated with the identi- 

35 fier. 

5. The system of claim 4, wherein the at least a portion 
of the handwritten notes is selected by a user using 
an input device. 

40 

6. The system of claim 1 , wherein the identifier is gen- 
erated from a data signal from a telephone device 
operatively connected to the processor to be asso- 
ciated with a set of handwritten notes. 

46 

7. The system of claim 1 further comprising: 

a handwriting capturing device for capturing the 
handwritten notes to generate data signals cor- 
50 responding to the handwritten notes on a plu- 

rality of pages, with a set of the handwritten 
notes including a respective handwritten page 
identifier; and 

th processor proc sses the handwritten notes 
55 by processing the data signals to generate a 

respectiv electronic id ntifier corresponding 
to a respective handwritten page identifier and 
associated with the respective electronic copy 
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to facilitate the managem nt of the electronic 
copies. 

8. The system of claim 1 wherein the processor is 
adapted to transfer the electronic copies, with the 
respective electronic identifiers, to a second proc- 
essor capable of managing the electronic copies 
using the electronic identifiers. 

9. The system of claim 1 wherein the processor further 
includes: 

means for managing the electronic copies by 
merging pairs of electronic copies having substan- 
tially similar electronic identifiers. 

10. The system of claim 9 wherein the managing 
means, responsive to a selection signal received 
from the user to select a pair of electronic identifiers 
as being substantially similar, merges the pair of 
electronic copies corresponding to the selected pair 
of electronic identifiers. 

11. The system of claim 9 wherein the managing 
means, responsive to an automerge setting, auto- 
matically compares pairs of electronic identifiers to 
determine a condition of substantial similarity be- 
tween respective pairs, and automatically merges 
a pair of electronic copies corresponding to a pair 
of electronic identifiers having the condition of sub- 
stantial similarity. 

12. The system of claim 11 wherein the managing 
means includes: 

measuring means for determining a similarity 
measure from respective pairs of electronic 
identifiers; and 

threshold means for determining the condition 
of substantial similarity from the similarity 
measure exceeding a predetermined thresh- 
old. 



ies with the resp ctiv sheets of pap r having 
the handwritten notes. 

14. The method of claim 1 3 wherein the step of provid- 
s ing the electronic copies includes the step of down- 
loading the electronic copies as data signals to a pr 

15. The method of claim 1 3 wherein the step of receiv- 
ing the handwritten notes includes the steps of re- 

io ceiving a capacitive effect from the surface being 
capacitance-sensitive; and 

the step of generating the electronic copies in- 
cludes the steps of converting the received capac- 
itive effect to corresponding data signals as the 

'5 electronic copies: 

16. The method of claim 13 wherein the step of man- 
aging the electronic copies includes the steps of: 



20 comparing the electronic identifiers; and 

merging a pair of electronic copies upon a de- 
termination of the corresponding electronic 
identifiers as being substantially similar. * 

2S 
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13. A method for managing electronic copies of hand- 
written notes, the method comprising the steps of: 

45 

receiving handwritten notes on a plurality of 
sheets of paper, wherein such handwritten 
notes include a handwritten identifier on a re- 
spective sheet of paper; 

generating electronic copies of each sheet of so 
paper having the handwritten notes, wherein 
each electronic copy includes an electronic 
identifier corresponding to the handwritten 
identifi r; 

providing the electronic copi s, including the ss 
electronic identifiers, to a processor; and 
managing th electronic copi s using the elec- 
tronic identifiers to correlate the electronic cop- 
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